On Stein’s equation, Vandermonde matrices and Fisher’s information matrix of time series processes. Part II: The ARMAX process
نویسندگان
چکیده
An approach is presented to get interconnections between the Fisher information matrix of an ARMAX process and a corresponding solution of a Stein equation. The case of algebraic multiplicity greater than one and the case of distinct eigenvalues are addressed. Appropriate links are constructed for these two cases by applying a factorization both for the Fisher information matrix and for a corresponding solution of a Stein equation. These factored forms are nonsquare linear systems of equations Ax = b, the kernels of the appropriate coefficient matrices are described. These are of fundamental importance for the solutions of the obtained linear systems. The structured coefficient matrix associated with the factored form of the Fisher information matrix is composed by basis vectors associated with an ARMAX polynomial, whereas the coefficient matrix obtained through the solution of a Stein equation consists of resolvant matrices associated with a companion matrix used in a corresponding Stein equation. The presence of Vandermonde matrices in right inverses of coefficient matrices of the obtained linear systems is investigated. Links between coefficient matrices which originate both from the Fisher information matrix and a corresponding solution of the Stein equation are derived. An example is provided for illustrating a solution of a Stein equation in terms of the Fisher information matrix as well as for describing the kernels of the appropriate coefficient matrices. AMS classification: 15A06
منابع مشابه
On the solution of Stein's equation and Fisher information matrix of an ARMAX process
The main goal of this paper consists in expressing the solution of a Stein equation in terms of the Fisher information matrix (FIM) of a scalar ARMAX process. A condition for expressing the FIM in terms of a solution to a Stein equation is also set forth. Such interconnections can be derived when a companion matrix with eigenvalues equal to the roots of an appropriate polynomial associated with...
متن کاملSome Results on Vandermonde Matrices with an Application to Time Series Analysis
In this paper we study Stein equations where the coefficient matrices are in companion form. Solutions to such equations are relatively easy to compute as soon as one knows how to invert a Vandermonde matrix (in the generic case where all eigenvalues have multiplicity one) or a confluent Vandermonde matrix (in the general case). As an application we present a way to compute the Fisher informati...
متن کاملOnline Streaming Feature Selection Using Geometric Series of the Adjacency Matrix of Features
Feature Selection (FS) is an important pre-processing step in machine learning and data mining. All the traditional feature selection methods assume that the entire feature space is available from the beginning. However, online streaming features (OSF) are an integral part of many real-world applications. In OSF, the number of training examples is fixed while the number of features grows with t...
متن کاملMatrix Algebraic Properties of the Fisher Information Matrix of Stationary Processes
In this survey paper, a summary of results which are to be found in a series of papers, is presented. The subject of interest is focused on matrix algebraic properties of the Fisher information matrix (FIM) of stationary processes. The FIM is an ingredient of the Cramér-Rao inequality, and belongs to the basics of asymptotic estimation theory in mathematical statistics. The FIM is interconnecte...
متن کاملNew Bases for Polynomial-Based Spaces
Since it is well-known that the Vandermonde matrix is ill-conditioned, while the interpolation itself is not unstable in function space, this paper surveys the choices of other new bases. These bases are data-dependent and are categorized into discretely l2-orthonormal and continuously L2-orthonormal bases. The first one construct a unitary Gramian matrix in the space l2(X) while the late...
متن کامل